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Abstract. In this paper we discuss a stochastic analog of Aubry- 
Mather theory in which a deterministic control problem is re- 
placed by a controlled diffusion. We prove the existence of a min- 
imizing measure (Mather measure) and discuss its main proper- 
ties using viscosity solutions of Hamilton- Jacobi equations. Then 
we prove regularity estimates on viscosity solutions of Hamilton- 
Jacobi equation using the Mather measure. Finally we apply these 
results to prove asymptotic estimates on the trajectories of con- 
trolled diffusions and study the convergence of Mather measures 
as the rate of diffusion vanishes. 
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1. Introduction 

The objective of this paper is to understand a stochastic analog of 
Aubry-Mather theory. The original problem ||Mat91|| consists in deter- 
mining a probability measure in T"^ x M" (T" is the n-dimensional 
torus) that minimizes the average action 

(1) / L{x,v)dfi 
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for a given Lagrangian L with the constraint that /i is invariant under 
the flow generated by the Euler-Lagrange equations associated with L. 
This problem is equivalent ||Mat01|| to the relaxed problem of minimiz- 
ing (|I]) with the constraint 



vDx4>dfj, = 



for any (f){x). In the case of controlled diffusions, we replace this con- 
straint by 



A^^d/i = 0, 



for all (p smooth and periodic, in which A" is the infinitesimal generator 
of the controlled diffusion. 

We proceed as follows: in section ^ we construct a relaxed minimiza- 
tion problem on a space of measures. Then, in section ^, we identify 
its dual by means of Fenchel-Rockafellar duality theorem ||Roc66|| . This 
dual problem turns out to involve Hamilton- Jacobi equations which are 
studied in section ^. We prove equivalence between the strong and weak 
problems (section and characterize the minimizing measures using 
viscosity solutions of Hamilton- Jacobi equations (section ^. The we 
discuss several applications: regularity of Hamilton- Jacobi equations 
(section logarithmic transform, connection with eigenvalue prob- 
lems (section H) asymptotics for controlled diffusions (section and 
convergence of the stochastic Mather measure as the diffusion coeffi- 
cient vanishes (section p!0|). 

The original Mather problem, as well as its stochastic version are con- 
vex linear programming problem over a space of Radon measures. Re- 
lated control problems have been studied by duality ||VL78a|| , ||VL78b|| , 
P^ , rV89|| , [FV8l and ||]^Je89| |, in which Fenchel-Rockafellar du- 



ality theorem ||Roc66|| is used to analyze optimal control problems. In 
this paper we apply similar techniques to understand Aubry-Mather 
theory and its stochastic analogs. 

Several authors have studied the relation between viscosity solutions 
of Hamilton- Jacobi equations and Mather measures [^at97^, [^at975[, 
|]^'at98a|| , [|b'at98b|| , [|E^ , ||EG99|| , ||GomOOa|| and ||GomOOb|| . The results 



by A. Fathi [|b'at97a|| , ||i^'at97b|| , [|b'at98a|| , ||l^'at98b|| , and W. E iE99 



make clear the connection between viscosity solutions and Hamiltonian 
dynamics. The main idea is that if u{x, P) is a viscosity solution of 



(2) 
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(here H is the Legendre transform of L) then there exists an invariant 
set I contained on the graph 

{{x,P + D,u{x,P))}. 

Furthermore, X is a subset of a Lipschitz graph, i.e., Dxu{x,P) is a 
Lipschitz function on 7r(X), where 7r(x,p) = x. If H is different iable 
at P, then any solution {x{t),p{t)) of (|l]) with initial conditions on I 
satisfies 

(3) lim m±D^ ^ „ 



In IIGomOOal and ||GomOOb| this problem is studied with detail and 



more precise asymptotic results are presented. We also prove regularity 
results for viscosity solution of (0) - in particular uniform continuity in 
P. In [|EG99|| Mather measures are used to prove regularity for solutions 
of Hamilton- Jacobi equations. The main results are type estimates 
in the difference quotients of D^u. The objective of this paper is to 
generalize these results to the stochastic case. 

2. Stochastic Mather measures 

In this section we define a stochastic analog of the Mather's min- 
imal measure problem ||Mat89|| , ||Mat91|| , ||Mn92|| , ||Mn96|| . To do so 



we consider an ergodic diffusion control problem and study an asso- 
ciated relaxed minimization problem on a space of measures. In the 
next section, we identify its dual by means of Fenchel-Rockafellar du- 
ality theorem and show that the dual problem is, in some sense, a 
Hamilton- Jacobi equation. 

Consider a controlled Markov diffusion |Jb'S9^j[| in 



(4) dx = vdt + adw, 

where v is a, progressively measurable control, w a n- dimensional Brow- 
nian motion and cr > the diffusion rate (cr = corresponds to the 
standard Aubry-Mather theory). The control objective is to minimize 
the long-time running cost 

1 '•^ 



lim —E I L(x,v)dt, 

over all admissible control processes v, this is called the ergodic control 
problem (here E denotes the expected value with respect to the un- 
derlying probability measure). We assume that the function L{x,v) is 
smooth in both variables, Z" periodic in x, coercive and strictly convex 
in V. Furthermore, since adding a constant to L does not change the 
nature of the problem, we also assume L > 0. 
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Let r2 = T" X M", where T" is the n-dimensional torus, identified, 
when convenient, with [0, 1]" or M" with a periodic structure (in geo- 
metric terms, MJ^ is the universal covering of T"). A pair {x,v) = z 
represents a generic point z & Q, with x G T" and v G R". Choose a 
function •j = 'j{\v\) : fl ^ [1, +oo) satisfying 

L(x,v) \v\ 
lim — -— = +00 lim — -— = 0. 

\v\^+oo 'y{v) \v\^+oo ^{v) 

Let be the set of weighted Radon measures on Q, i.e., 

Ai = {signed measures on with / 'yd\fi\ < oo}. 

Jn 

Note that Ai is the dual of the set C^(f2) of continuous functions (p 
with 

mp | — I < oo, hm — — — > U. 

n 7 |2:Hoo7(-y) 

For each bounded control strategy v consider the measure fir defined 
by 

1 '■^ 



(f)d^T = 7^E I (j){x{t),v{t))dt. 
T Jo 

As T +00 we may extract a weakly convergent subsequence ^ 
li{v). Let 

M.Q = d{fi{v) : V bounded control strategy}. 

Define 

Ml = {fi e M : dfi = l,fi>0}. 
Jn 

The stochastic analog of Mather's problem consist in determine a mea- 
sure jj, that minimizes 

(5) inf / Ldfi. 

^l&MonMl Jq 

For our purposes, however, it is convenient to consider a relaxed prob- 
lem by replacing Mohj a slightly larger set A/q that we define next. 

The infinitesimal generator corresponding to the controlled diffusion 
i)is 

2 

Proposition 1. Any measure iJ,{v) in Mq satisfies 

(6) j A^ipdfi = 0, 

for all tp = (f{x), ip periodic and (or if a = 0). 
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Proof. Consider the measure defined by 



1 



T 



<PdllT=7^E / (t){x{t),v{t))dt. 

Jo 

Assume ^ur-^/i- We claim that 

AVd^u = 0, 



for i^{x) and periodic function of x only. To see this recall Dynkin's 
formula: 

(^(x(T)) - V5(x(0)) = E ! A''^'^^{x{t))dt 



for any x{t) and v{t) that solve (^. In the case a = this is just the 
fundamental theorem of calculus. Dividing by T and letting T — oo 
we obtain (H). ■ 
Let A/q be the closure of the set of all measures that satisfy (|^): 



Mq = d{fi eM: [ A^<^dfi = 0, 
Jn 



In the case a = 0, the set A/o is the "measure theoretic" analog of the 
set of closed curves on T". Indeed, if ^ : [0, 1] — T" is a piecewise 
smooth closed curve the we can define a measure /ie by 

fd^ie= [' f{e{t),e{t))dt. 

Jo 

Clearly fig is in Aq, and since A/q is a linear space, it contains all linear 
combinations of measures of this form. 

The additional problem that we will consider is 



(7) inf / Lda. 

We will prove later on that 



(8) inf / Ldu = inf / Ldu. 

This identity is a consequence that A/q is the weak-* closure of A^q. 
However, the proof of this depends on (H) holding for a sufficiently 
large class of L (see ||1^'V89|| , ||b'V88|| , and |[b'le89|| for related proofs). 
Therefore we will prove directly. 

The last issue we discuss in this section is the existence of a measure 
that minimizes: 



inf / Ldfi. 

fieMoCiMi 
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This measure is the stochastic analog of the Aubry-Mather measure. 
A similar proof also shows that there exists a minimizing measure in 
A/q n Ail. In the next section we prove that 



inf / Lrf/i = inf / Ldfi. 

^ieMonMl J (leAfof^Mi J 

First we quote a compacity lemma: 
Lemma 1 (Mane ||Mn96|] ). In Mq fl Mi the set 



IS 



Ldn < c 



compact with respect to the weak-* topology in (C°)' 



With the help of this lemma we prove the existence of a minimizing 
measure. 

Theorem 1. There exists a measure E Aio H A4i such that: 



Ldfi = inf / Ldfi. 
tJ.eMonMi J 

Proof. Take any minimizing sequence fin- Since J Ldfi < c, the 
previous lemma shows that by extracting a subsequence, if necessary, 
Hn—^fJ-- Thus, for any fixed k, 

lim / min(L, k)d^n ^ / niin(L, k)dii. 

n^+oo J J 

Thus 

/min(L, < inf / Ld^, 
^l&Mor\Ml J 

for all k. But then by monotone convergence theorem 

Ldfi < inf / Ld/U, 

^l&Mof^Ml J 

which proves the theorem. ■ 
A similar proof yields: 

Theorem 2. There exists a measure G TVq (1 A4i such that: 



Ldfi = inf / Ldfj,. 
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3. Identification of the dual problem 
In this section we identify the dual problem of 



min / Ldfj,. 

fieMonMi J 

The dual problem involves a Hamilton- Jacobi equation. Further anal- 
ysis of this equation is carried out in the remaining sections and yields 
important information about the minimizing measure. 

First we review some facts about convex duality. Let i? be a Banach 
space with dual E'. The pairing between E and E' is denoted by 
(■,■). Suppose h : E ^ (— cxd, +cxd] is a convex, lower semicontinuous 
function. The Legendre-Fenchel transform h* : E' ^ [—00, +00] of h 
is defined by 

h*{y) = sup (-(x, y) - h{x)) , 

for y G E'. Similarly, for concave, upper semicontinuous functions 
g : E ^ (—00, +00] let 

g*{y) = inf {-{x,y) - g{x)) . 

Theorem 3 (Rockafellar ||Roc66|| ). Let E be a locally convex Haus- 
dorff topological vector space over M with dual E* . Suppose h : E —>■ 
{—00, +00] is convex and lower semicontinuous, g : E [—00, +00) is 
concave and upper semicontinuous. Then 

(9) sup^(x) - /(x) = inf /*(?/) -/(y), 

X y 

provided that either h or g is continuous at some point where both 
functions are finite. 

For G C^{n) define 

hi{(p) = sup {—(/){x,v) — L{x,v)). 
{x,v)efi 

Let C be defined by 

C = cl{0 : = AV, ip{x) G c2(r")}, 

here cl denotes the closure in C° (if cr = we may take ip{x) G C^(T")). 
If cr = 0, we may think of the elements in C as generalized closed 
differential forms; indeed if 6 : [0, 1] — T" is a piecewise smooth closed 
curve and G C then 

(t>dfJ,g = 0. 
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Define 



if e C 
— oo otfierwise. 



In tliis section we prove tliat 



(10) sup /l2(0) - /il((/>) 

</'GCO(n) 

is tlie dual problem of (|^). 

First we compute the Legendre-Fenchel transforms of hi and h2 in 
order to apply theorem ^ to (p^ . 



Proposition 2. We have 
hlifi) = 

and 

h*M 

Proof. Recall that 



/ Ldfi if e Ml 

-oo otherwise, 

if ^eAfo 

-oo otherwise. 



hKjj) = sup (— / (j)d^ — hi{(l)) 
<t>&c^{^) \ J 

We claim that if /i is non-positive then h\{^) = oo. 
Lemma 2. // ^ then h\{ij) = +oo. 

Proof. If yu ^ we can choose a sequence of positive functions 
(pn e C°(fi) such that 

J —(j)nd^ +00. 

Thus, since L > 0, 

sup —(j)n — L < 0. 

n 

Therefore if /i ^ then = +oo. h 

Lemma 3. // /U > then 

hlifi) > / Ld^-\- sup I / 'i/'fi/i — sup -0 J . 
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Proof. Let L„ be a sequence of functions in C°(n) increasing point- 
wise to L. Any function (f) in C°(Q) can be written as (f) — —Ln — ip, 
for some also in C°(Q). Thus 



sup ( — / (j)diJ, — hi{(j)) 



Since L„ — L < 0, 
thus 



sup I / Lndjj, + / ipdjj, — sup(L„ + ijj — L) \ . 
ECO(n) \J J J 



sup Ln — L < 0, 
n 



sup(L„ + ip — L) < sup -0. 
n n 



Thus 

sup I — / (t)dix — hi{(j)) I > sup I / LndijL+ / tpdfj, — sup{'ip) 

By the monotone convergence theorem J Lnd/i ^ J Ld/j,. Therefore 

sup I — / (j)diJ, — hi{(p) ) > / Ldii+ sup I / i/jd/j, — sup{'ip) 
as required. 

If / Ldfj, = +00 then hl{fj,) = +oo. If J d/i^ 1 then 

sup I / ijjdfj, — supi/j I > supa;( / d/j, — 1) = +00, 

by taking = ct, constant. Therefore hK/j,) = +00. 
If J dfj, — 1 we have, from the previous lemma 



by taking ■0 = 0. 
Also, for any (f) 



hiifJ') > J Ldfx, 

/(— — L)diJ, < sup(— — L), 
n 



if J dfj,— 1. Hence 



sup I — / (j)djj, — hi{(j)) \ < / Ldjj,. 
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Thus 



f Ld/i if fi e Ml 
+00 otherwise. 



Now we will compute h"^. First observe that if /x ^ A/q then there 
exists 6 E C such that 



(j)d^ ^ 0. 



and so 



inf — / (hda < inf a / Sda = —00. 

06C / oeK 



If /i G Ao then J (pd^ = 0, for all G C Therefore 
hKn) = inf — J (pdjj. = 



if ;U G ATo 
—00 otherwise. 



The Fenchel-Rockafellar duality theorem states that 
(11) sup ihicP) - h{<P)) = inUhUfi) - hlit,)), 

provided on the set /12 > —00, hi is continuous. In the next lemma we 
prove that hi is continuous, and therefore ([llD holds. 

Lemma 4. hi is continuous. 

Proof. Suppose 0n — in C°. We must prove that 

Observe that ||0n||7 and H^H^ are bounded uniformly by some constant 

C. The growth condition on L implies that there exists R > such 

that 

sup —0 — L = sup —(f) — L, 
n t^xBr 

for all 4> in Cj(fi) with ||0||^ < C, in which Br = {v eR'^ : \v\ < R} is 
the ball of radius R centered at the origin. On B^, (/)„—>■ (p uniformly 
and so 

sup —(pn — L ^ sup —(p — L. 

n n 

■ 

Denote by H* the value 

H* = - sup [h^icP) - hi{<p)) 
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Theorem 4. We have 

2 

= inf{A : 3^ G C^(T") : -^^^f + ^i^^V^ < -^1. 

in which 

H{p, x) = sup —p ■ V — L{x, v) 

V 

is the Legendre transform of L. 
Proof. Note that 

H* = inf sup A(p — vDxif — L = 



inf sup Ao9 + H{Dx'4:>:X). 



4. The Cell Problem 

The last theorem in the previous section suggests that we study the 
equation 

2 

(12) -—Au + H{D^u,x) = H. 

In this section we prove that there exists a unique number H for which 



(|T2|) has a periodic viscosity solution. Using the results from ||Kry87|| , 
we show that such solution is C^. Then we prove that the solution is 
unique (up to additive constants). Finally we prove estimates on H 
and u that do not depend on a. 

Theorem 5. There exists a unique number H for which the equation 

2 

-y Ali + H{D^u, x) = H 

has a periodic viscosity solution. Furthermore the solution is and 
unique. 

Proof. First we address the issue of the existence of a viscosity 
solution. To do so consider the infinite horizon discounted cost problem 

POO 

.a _ ■( TP i „-at ] 



= infE / e-'^'L{x,v)dt 
Jo 

with dx = vdt + adw. Then is a periodic viscosity solution of ||FS93|| 

-Am" + H{D^u'^, x) + au" = 0. 
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Since is periodic, uniformly Lipschitz in a |[FS93|| there exists a 
subsequence and u periodic for which 



u'^ — minw" u. 



Since < < ^ we have au" — > —H, for some H (extracting a further 
subsequence if necessary). Then w is a periodic viscosity solution of 

2 

-—Aw + H{D^u, x) = H. 

This solution u is actually by standard regularity results for non- 
linear uniformly elliptic equations |[Kry87|| . 



To prove uniqueness of H, suppose, by contradiction, that Ui and Hi 
{i = 1,2) solve 

-Atij + H(D^Ui, x) = Hi. 

Suppose ui — U2 has a local maximum at xq. Then D^ui = DxU2 
and Aui < Au2 at Xq. Thus we conclude Hi > H2- By symmetry 
Hi = H2- 

To prove that the viscosity solution is unique suppose, by contradic- 
tion, that u and v are two distinct solutions (i.e., u — v is non constant) 
of _ 

-Au + H{D^u,x) = H. 

We may assume some small ball centered at the origin of radius 7 
does not contain any maximizer of Xq of u{x) — v{x) (otherwise, for 
convenience, we may shift the coordinates). Fix e, A > and assume 
that 

u{x) - v{x) - ee"^'^' 
has a local maximum at a- First observe that x^x is uniformly 
bounded and by passing to a subsequence, if necessary, we may as- 
sume x^^x ^ Xq as e ^ 0. At x^ x "we have 



12 



and 
Since 
we have 



Au<Av- 2eAe-^l"l' + eA^I V^l'l'). 
= -A{u -v) + H{D^u, x) - H{D^v, x) 



> -2eAe~^l"-^l' + eX^lx.^xl^e-^^'^^^'^' + O(eA). 

Observe that for e small enough \x^^x\ > I- Dividing by ee"'^'"^^'^'^ and 
letting e — > we observe that 
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Therefore sending A ^ oo yields a contradiction. ■ 
Proposition 3. H can be estimated independently of a by 
inf H{0,x) <H < sup H{0,x). 



Proof. Suppose u has a minimum at Xq. Then — ^Aw(xo) < and 
Dxu{xo) = 0. Thus 

2 

H = -^Au{xo) +H{DxU,xo) < H{0,xo) < supH{0,x). 

^ X 

The other estimate is similar. ■ 
Finally we recall that standard estimates for controlled diffusions 
|[FS93|| also yield that u is semiconcave (with semiconcavity constant 
independent of a) and Lipschitz (also independently of a). 

5. Equivalence between weak and strong problems 

The next task is to prove that the value if*, computed by considering 
a infimum over measures in A/q is the same as 

H = - inf {hl{^^)-h*M). 
A useful characterization of H is: 

Theorem 6. H is the unique value for which the equation 

2 

(13) -—Au + H{DxU,x) = H 

has a periodic viscosity solution. 

Proof. We know from theorem ^ that there is a single number H 
for which (0) admits a periodic viscosity solution u. We can use that 
solution to build a Markov feedback strategy to control the diffusion: 

dx = —DpH{DxU, x)dt + adw. 

To this diffusion it corresponds a measure // G A/lo H A^i for which 



Thus 



Ld^i = —H. 



~H > inf / Ldu. 

MonMi ' 



Conversely, let u{x) be a solution of (|T3|) and assume that 



-H < inf / Ldu. 

MoCiMi ' 
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Then for any control strategy u* and corresponding process x* and all 
large enough T 

1 '•^ 



I L{x\u*)>-H + e. 





Thus 

r — 

u{x) = mi E / L(x , v) + H dt + u{x* (T)) > eT + mm u{x) , 
''Jo ^ 

which is a contradiction for T sufficiently large since u is bounded. 
Theorem 7. H* is the unique value for which the equation 

2 

-^/\u + H{D^u,x) = 
has a periodic viscosity solution. 

Proof. First suppose w is a periodic viscosity solution of 

2 

-—Aw + H{D^u, x) = H. 
2 



Then we claim that there is no smooth function -0 with 

2 

-^Au + H{D,ij,x)<H. 

Indeed, if this were false, we could choose a point xq at which u — tfj 
has a local minimum. At this point we would have 

2 

~^Aij + H{D,tP,xo) >H, 

by the viscosity property. Hence H* > H, by theorem ^. 

To prove the other inequality consider a standard moUifier r]^ and 
define u^ = rj^* u, in which * denotes convolution. Then 

2 

-yAw, + H{D^u„ x) <H + /i(e, x), 

where 

h{e,x) = sup sup \H(p, x) — H{p,y)\, 

\p\<R\x-y\<e 

where i? is a bound on the Lipschitz constant of u. Let 

= H + sup /i(e, x) . 



u. satisfies 



2 



Thus H* < lim,^n = H. Hence H'' = H. 
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This proof holds even when a = 0, for a 7^ since u is C^, the 
molhfication step is unecessary. 

Corollary 1. We have 

inf (hlif,) - h;if,)) = inf (hlif,) - h;ifi)). 

Proof. Our previous results show that we can construct a probability 
measure /i on A^o such that 

/ Ldf,= -H= mUhlifi)-h*M). 

J fiGAfo 

Since A4o C Ao this completes the proof. ■ 

6. Properties of Stochastic Mather measures 

In this section we study general properties of Stochastic Mather mea- 
sures. First we prove that the stochastic Mather measure is supported 
in the graph {x,—DpH{DxU,x)) for any u viscosity solution of (|13]). 
Then we show that the projection of this measure in the x axis has a 
density that satisfies an elliptic partial differential equation. 

Theorem 8. Any stochastic Mather measure is supported in the graph 
(x, —DpH{DxU,x)) for any u viscosity solution of ([7^. 

Proof. Recall that for any v we have 

— ^^"^ ~ vDxU — L(x, v) < H 



with strict inequality unless v = —DpH{DxU,x). Note that 

——Au — vDxudfi = 

and 

— J L{x,v)dfi = H, 
Thus n is supported on (x, —DpH^D^u, x)), otherwise we would have 

L{x, v)dn < H 

which would be a contradiction. ■ 
Since any stochastic Mather measure is supported on a graph, a 
natural question is whether its projection in the x coordinates has a 
density. The answer to this question is affirmative and we prove that 
this density is the solution of an elliptic partial differential equation. 
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Theorem 9. Let /i be a stochastic Mather measure. Let v denote the 
projection of n in the x coordinates. Then v = 9{x)dx for some density 
e W^''^ . Furthermore 6 is a weak solution of 

(14) -V{ev{x)) + JcT^A^ = 0. 

forv = -DpH{D^u,x). 

Proof. Recall that for any smooth and periodic (f){x) 

/2 
yA^ + v{x)D^(pdL^ = 0. 

Let 7]^ be a standard mollifier, (f)^ = rj^ * r]^ * v and J^e = Ve* ^- Note 
that z/e is a bounded periodic C°° functions (the bounds may depend 
on e). Then 

= y" y|Vzv,|2rfx- J v{x)D^{(f),)du. 



Thus 



Note that 



Dxi'^)rie * {vi')dx\ < I J {Dxi'e)v{x)i'^dx\ + 
+ I / {Dj,v^){ri^ * ivu) - v{x)v^)dx\. 



The first term on the right-hand side can be estimated by 

^ j \D^Ue\'^dx + ^ J \ue\'^dx, 

for any small 7 > 0. To estimate the second term observe that since v 
is Lipschitz 

\r]^ * (viy) - v{x)u^\ < J rj^{x - y)\v{x) - v{y)\du{y) < Cev^. 



Thus 



j Dxi'^(r]e * (vu) — v{x)i'^)dx\ — ^ J \DxT^'^^dx H j \i'^^dx 



therefore we conclude that 



j iDxI^el^dx — ^ J Wel'^dx, 



A STOCHASTIC ANALOG OF AUBRY-MATHER THEORY 17 

uniformly in e. Now observe that iy^> and 

u^dx = 1. 



If J {u^l'^dx were unbounded then we could normalize it defining = 
7ei^e with J \ae\'^dx = 1 and 7^ 0. Since € W^'^ uniformly, through 
some subsequence it converges in to some a ^ L"^ with J \a\'^dx = 1. 
However a > and J a = which is a contradiction. Therefore we 
must have G W'^''^ uniformly in e. Thus through some subsequence 
^ 9 for some 6 G W^'"^. Thus du = 9{x)dx. Consequently, 6' is a 
weak solution of 

-viev{x)) + ^(T^^e = 0. 

■ 

Observe that equation (0) is a non-symmetric zero eigenvalue prob- 
lem. It is well known [[PW84|| that 

~V{9v{x)) + = 

has a principal eigenvalue A with positive eigenfunction 6. To see that 
A = just observe that 

= J yA^ - V {v{x)e{x)) = A y" 

Since 9 is non-negative we get A = 0. 

The previous theorem yields several important identities that we will 
use in the next section. First define H{P) to be number for which 

a2 _ 

(15) -—Au + H{P + D^u,x) = H{P) 

has a periodic viscosity solution u{x, P) (note that u may not be con- 
tinuous in P). The function H{P) is convex in P and so twice differ- 
entiable for almost every P. 

Proposition 4. For any (j){x) periodic 

(16) - J D^cpDpHOdx +Y J ^4>^dx = 0. 
Furthermore 

(17) j D^HBdx = 0. 
Finally, for any P and P' , 

(18) {P' -P) j DpHOdx < H{P') - H{P), 
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in particular if H is differentiable 

j DpHOdx = DpH{P). 

Proof. Observe that (|T6|) follows from 



= y (^{eDpH) + ^ff^A^^ dx 



by integration by parts. 

Let ?7e be a standard moUifier and let u^ = rj^* u. Then 

^ +T]e* H{D^U, x) = H. 

Differentiate the previous identity with respect to xf 

2 

Since Hp. is Lipschitz in x we have 

?7, * {Hp^D^^^^u) = Hp^D^^^^Ue + 0(e). 

Note also that 

a2 



—AD.^M, + Hp^D^^^^u.j Odx = 
since D^-u^ is smooth and periodic. Thus 

1]^ * H^fidx 
as e — ^ 0. Since rj^ * H^^ H^^ almost everywhere we conclude 

H^edx = 0, 



which proves (|Tj 

To prove the last part of the proposition, note that 

H{P' + D^u{x,P'),x) - H{P + D^u{x,P),x) > 

DpH{P + P),x) [P' + D^u{x, P')-P- D,u{x, P)] 

Let w = u{x, P') — u{x, P). Note that 



2 



Aw + DpH{P + D,^u{x, P),x)D^w ) 9dx = 0. 



Thus 



(P'-P) J DpH{P + D.Mx,P),x) < H{P') - H{P), 
as required. 



a stochastic analog of aubry-mather theory 
7. Regularity estimates 
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In this section we prove L^-type regularity estimates for the solution 
of (|15|). These estimates are expressed using the invariant measure. 
A major advantage is that it is possible to prove LP'iO) estimates for 
the difference quotient \Dxu{x + y) — Dxu{x) \ that do not depend on a 
explicitly whereas pointwise or estimates with respect to Lebesgue 
measure depend on a. Therefore our estimates extend up to the case 
o" = 0, for a careful study of this case consult | EG99|| , | GomOOa |, and 
PomOOb|| . 



Theorem 10. Suppose u solves (It) and y E M". Then 



(19) 



\Drcu{x + y) — Dxu{x)f 9dx < C\y\ 



Furthermore, if H{P) is twice diff'erentiable at P then 



(20) 



j \D^u{x,P) - D^u{x,P')fedx < C\P-P'\^, 



for \P — P'\ sufficiently small. 
Proof. Note that 



a 



[Au{x + y) - Au{x)]+H{D^u{x + y),x + y)-H{D^u{x),x) = 0. 



Since H is convex, 

H{Dxu{x + y),x + y) - H{D^u, x) > 7 \Da:wf + 
+DpH{D^u{x), x)D^w + D^H{D^u{x),x)y + 0{y^), 

with w = u{x + y) — u{x). Integrating with respect to 6dx to obtain 



7 



j \D^wfedx < C|^/|^ 



smce 



and 



cr 



DpH{D,j.u{x), x)DxW Aw 



9dx = 0, 



/ 



D^H(D^u{x),x)9dx = 0. 



Similarly, let w = u{x, P') — u{x, P) and assume H{P) is twice dif- 
ferentiable at P. Then 

DpH{P){P' -P) + C\P - > 

- ^Aw + H{P' + D^u{x,P'),x) ~ H{P + D^u{x, P) , x) 
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Note that 

H{P' + D^u{x, P'),x) - H{P + D^u{x, P),x)> 
> DpH{P + P),x){P' -P + D^w) + 7 |P' - P + D^w\^ . 

Thus 

(21) 7 j \P' + D^u{x,P') - P - D^u{x,P)f 9dx <C\P - P'\^, 



since 



and 



[P' -P) j DpHiP + DM^, P),x)9dx = {P' - P)DpH, 



-yAw + DpH{P + D^u{x, P),x)D^w = 0. 

From (^ we have _ ■ 

In the next theorem we prove that if H is strictly convex in a neigh- 
borhood of a point P then the map (x, P) — P + Dxu{x, P) is non- 
degenerate. In the non-random case this result is extremely impor- 
tant since it proves the invariant sets {x, P + D^u) change with P, see 
[PomOOa|| for a detailed discussion. 



Theorem 11. Suppose H is strictly convex at a neighborhood of a 
point P. Then 



(22) 



J \P + D^u{x, P) - P' - D^u{x, P')\^ 9dx > C|P-Pf , 



for |P — P'l sufficiently small. 

Proof, let w = u{x, P')—u{x, P) and assume H{P) is strictly convex 
in a neighborhood of P. Then 

DpH{P){P' - P) + C|P - Pf < 

2 

< -yAu7 + //(P' + P'^.u(a;,P'),a;) -//(P + P>^.m(x,P),x) 
Note that 

H{P' + D^u{x, P'),x) - H{P + D^u{x, P),x)< 
< DpH{P + D^u{x, P), x)(P' - P + D^w) + T\P' -P + D^wf . 
Thus 

r j \P' + DMx,P')-P-D^u{x,P)\^edx>C\P~P'\'^ 
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since 

{P'-P) j DpH{P + D^u{x,P),x)edx = {P' -P)DpH 



and 

f 2 

^ -Aw + DpH{P + D^u{x, P),x)D^w = 0. 



In the case a = it is possible to prove L°°-estimates on D'^^u 



on the support of 6 ||EG99|| . However, this is not the case for a > 
0, at least with estimates independent on a. Indeed, if D^^u were 
uniformly bounded in a then u^r would converge uniformly, through 
some subsequence as a ^ 0, to a function u, viscosity solution of 

H{D,u, x) = H. 

But then u would be both semiconvex and semiconcave and we know 
that, in general, u is only semiconcave. However, some regularity ex- 
ists, as was remarked in section |, namely one-sided bounds on D^^u 
(semiconcavity) that do not depend on a. 

8. Explicit Formulas and Examples 

In this section we discuss several formulas for both H and invariant 
measures. The next proposition shows that given the solution u{x, P) 
it is possible to compute the density 6 (under smoothness assumptions), 
not of the invariant measure but of a time-reversed version. 

Proposition 5. Assume u{x, P) is a smooth solution of (|73|j. Then 

e = det{I + Dlpu) 

is a solution of a time-reversed version of l^m): 

2 

(23) yA^ + V(6't;(x)) = 0. 
Proof. Let v{x, P) = Px + u{x, P). Then 

2 

(24) -^Av + H{D,v, x) = H{P). 
The claim is that 6 = det D^pV solves 

+ ViODpHiD^v, x)) = 0. 
Differentiate (El) with respect to Pi to get 



2 



-Avp + DpHDlpV = DpH 
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Note that DpHD^pV = (Dlpv)^ DpH and multiply the previous iden- 
tity by the cofactor matrix cof D^pv 

— — cof DxpvAvp + det DxpvDpH = cof DxpvDpH. 

Observe that cof D^^pf is divergence free [[Eva98|| and so 
cof DxpvAvp = V(det D^pv). 

Therefore 

— — V(det Dxpv) + det D^pvDpH = cof D^pvDpH. 
By applying V to the previous identity we have 



-—AO + V{eDpH) = 0. 



2 



Now we turn our attention to the special case 

2 

Hip,x) = ^ + V{x), 



with V periodic. For this special Hamiltonian we will present an al- 
ternative representation formula for H{P) as well as exhibit a (non- 
periodic) invariant measure. This will follow some ideas of ([ Hol77]| ). 
Suppose « is a periodic viscosity solution of 



2 

-y Am + H{P + D^u, x) = H{P). 



Define 

Then 6 solves 



Px + u 



—A(j) + V{x)(l) = H{P)(p. 



Thus H is an eigenvalue of the operator + V{x)(j). Consider the 

related operator 

Lip = e^—A{e"^ip) + V{x)ilj = —Aijj - a'^PD^tjj + {V{x) + 

2 2 2 

Then H is also an eigenvalue of L with periodic boundary conditions. 
Proposition 6. H is the principal eigenvalue of L. 
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Proof. The operator L has a principal eigenvalue A with positive 
and periodic eigenfunction (f. Let u = — log ip. Then u is smooth, 
periodic and satisfies the Hamilton- Jacobi equation 

2 

-yAn + H{P + D^u, x) = A. 

By uniqueness of H we have X = H. ■ 
Finally we exhibit an invariant measure for this system. Although 
this is not a probability measure (unless P = 0). 

Proposition 7. Let 9 = e"^^ . Then 6 is an invariant measure. 
Proof. It suffices to check that 

2 

'^M + V{{P + D^u)9) = Q. 



9. ASYMPTOTICS 

In this section we study the asymptotic behavior of the controlled 
process x{t). First we will do some formal calculations motivated by 
the case a = |EG99|] , [|GomOOa|] , [|GomOOb|] . Define 



X = X + Dpu. 

Then 



dX = dx + Dp^udx + —Dp^^udt 



Thus, since dx = —DpHdt + adw, 



dX = (^-DpH{I + Dl^u) + Y^PxxU^ dt + a{l + Dj,^u) dw. 

Note that -DpH{I + Dj^^u) + ^D^^^u = -DpH and so 
E{X{t) - X{0)) = -DpHt. 

Theorem 12. Suppose H is differentiable at P. Then 

lim = -DpH. 

t^oo t 



Proof. Let m be a viscosity solution of ([15|). Let v* be an optimal 
control such that 

u{x, P) = E [ L{x, V*) + Pv* + H{P) + u{x{t), P). 
Jo 
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Jo 

Subtracting these two equations 



C <E [ (P' - P)v* + H{P') - H{P). 




Jo 

since dx = v*dt + adw we have 



E f V* = E [ dx = Ex{t). 



Jo Jo 



10. Convergence as a 







In this last section we prove that stochastic Mather measures con- 
verge to a Mather measure as the diffusion rate a vanishes. 
Let Her be the unique number for which 



has a periodic viscosity solution u^^. The bounds on obtained in 
section^ imply that through some subsequence H as a ^ 0, for 

some number H. Since is uniformly Lipschitz in a, through some 
subsequence u„ u uniformly. Standard stability results on viscosity 
solutions imply that u is a viscosity solution of 



Let fia be a stochastic Mather measure associated with (pSl) . Since 
the support of fi^ is bounded independently of a we can extract a 
weakly convergence subsequence ^ ii and j dfi = 1. Note that 



(25) 




H{D^u,x) = H. 




Furthermore, for any smooth function (f){x) 




Thus satisfies 




H 
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with the constraints J dfj,— 1, and J vD^cjxifj, — 0. Thus /x is a Mather 
measure. 
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